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ABSTRACT 


**•  Linear  programming  has  been  used  to  maximize  alloca* 

tion  problems  in  many  fields.  This  technique  wilt*  be 

A 

applied  to  the  problem  of  planning  research  with  optimal 


allocation  of  limited  resources.  A  model  ie>  constructed 


with  detailed  information  concerning  necessary  inputs  and 
resultant  outputs,  amplified  by  sample  problems.  A  sensi¬ 
tivity  analysis  and  interpretation  of  all  results  is 
included .  The  model  has  been  constructed  to  be  of  primary 
interest  to \he  Office  of  Naval  Research  but  can  be  adjusted 
to  the  needs  o\  other  groups  engaging  in  research. 
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INTRODUCTION 


In  recent  years,  the  increased  emphasis  on  research  and 
development,  by  both  private  and  governmental  organizations, 
has  raised  the  questions  "Can  research  be  planned?"  and  "If 
so,  can  it  be  planned  optimally?"  This  report  concerns  the 
second  question,  the  problem  of  the  optimal  allocation  of 
funds  for  the  accomplishment  of  a  research  objective.  The 
technique  proposed  in  this  thesis  to  answer  the  second 
question  is  linear  programming. 

Linear  programming  was  first  suggested  as  a  technique 
to  explore  the  area  of  research  planning  by  Dr.  Fred  Rigby 
of  the  Office  of  Naval  Research.  His  paper  "Activity  Analysi 
of  Research  Planning  in  ONR" ,  written  in  1963,  proposed  the 
feasibility  of  constructing  a  model  predicated  on  the  re¬ 
search  effort  of  ONR  and  utilizing  linear  programming. 

Prior  to  the  paper  by  Dr.  Rigby,  the  Office  of  Naval 
Research  had  completed  a  study  of  research  planning  which 
was  called  the  "Ad  Hoc  Research  Planning  Committee  Report," 
This  study  effort  was  headed  by  Captain  J.  F,  Gustaferro, 

USN.  An  outgrowth  of  the  study  was  a  report  by  Herman  I. 
Shaller,  also  a  member  of  the  Ad  Hoc  Committee;  his  report 
is  titled  "An  Exploratory  Study  in  Research  Planning  Method¬ 
ology"  . 

v  •  ' 
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This  thesis  utilizes  the  information  in  the  above 
reports  and  is  an  attemDt  to  implement  the  suggestion  made 
by  Dr.  Rigby  to  utilize  linear  programming  for  the  investi¬ 
gation  of  research  planning. 

For  the  purpose  of  the  thesis,  an  organization  diagram 
of  ONR,  Appendix  4,  has  been  simplified  into  the  following 
form: 

PPPPAROH  HFAD 

Branch  Heads f^ield  1/  [Field  2 1  Field  3f 

Category  1]  Category  3f  Category  ij 
Category  ^  Category  ^1  Category 
A  total  budget  is  received  by  the  research  head,  and 
is  passed  on  to  the  department  or  branch  heads.  These 
individuals,  each  heading  a  particular  scientific  field, 
such  as  biology  or  physics,  must  then  decide  how  to  allocate 
available  funds  among  the  various  activities  comorising 
their  particular  departments.  The  smallest  sub-division 
of  a  particular  department  engaging  in  research  is  called 
a  category.  Examples  of  categories  in  the  Electronics 
Department  of  ONR  may  be  found  in  Appendix  3,  page  (72  )• 
This  thesis  assumes  that  the  department  heads  will  divide 
the  total  budget  among  the  categories  rather  than  by  making 
an  initial  allocation  to  the  departments.  The  problem, 
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therefore,  is  that  of  dividing  the  budget  among  the  categories 
to  maximize  the  research  effort. 

To  maximize  the  research  effort  of  the  organization,  the 
particular  mission  of  that  organization  must  be  examined. 

The  mission  of  ONR  is:^ 

to  encourage,  promote,  plan,  initiate,  and  coordinate 
naval  research  to  provide  for  the  maintenance  of  future 
naval  power  and  the  preservation  of  national  security; 
to  conduct  naval  research  in  augmentation  of  and  in 
conjunction  with  research  and  development  conducted 
by  the  respective  bureaus  and  other  agencies  and 
officers  of  the  Department  of  the  Navy;  to  supervise, 
administer  and  control  all  activities  within  or  on 
behalf  of  the  Department  of  the  Navy  relating  to 
patents,  inventions,  trademarks,  copyrights,  royalty 
pavments  and  matters  connected  therewith;  to  represent 
the  Department  of  the  Navy  in  dealings  of  Navy-wide 
interest  on  research  matters  with  other  government 
agencies,  corporations,  educational  and  scientific 
institutions,  and  other  organizations  and  individuals 
concerned  with  scientific  research;  to  survey  the 
world-wide  findings,  trends,  potentialities  and 
achievements  in  research  and  development,  keep  the 
ASM  (R  and  D)  and  the  Chief  of  Naval  Operations  ad¬ 
vised  thereon,  and  disseminate  such  information  as 
appropriate  to  interested  bureas  and  offices  within 
the  Department  of  the  Navy,  and  to  other  Governmental 
or  private  agencies. 

tom  purpose  of  the  linear  programming  model,  this 

mission  must  be  described  by  a  particular  distinct  set  of 
objectives  which  must  be  internally  independent.  ONR  calls 
these  objectives  attributes .  Clearly  the  mission  of  an 
organization  may  be  described  by  more  than  one  set  of  attri¬ 
butes  or  objectives,  Each  particular  set  of  attributes 


^Office  of  Naval  Research  Organization  Manual,  ONR 
Inst.  5420. IE,  Aug,  1961 
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which  describe  the  mission  is  called  a  classification  system 
Examples  of  attributes  in  a  classification  system  might  be 
scientific  value  ,  military  value,  and  technological  value. 
Examples  of  other  classification  systems  used  in  the  Navy 
are  shown  in  Appendix  3,  page  (73  ).  Therefore,  attributes 
are  organizational  objectives, 

Inter-relations  and  dependencies  exist  between  Navy 
bureaus  and  the  research  activity  of  ONR.  An  example  of 
■9uch  a  situation  may  be  described  in  this  manner:  Assume 
that  scientific  value,  military  value,  and  technological 
value  comprise  one  classification  system,  and  that  anti¬ 
submarine  warfare,  air  warfare,  and  surface  warfare  are 
another,  both  describing  ONR's  research  effort.  Increased 
research  activit*  in  underwater  sound  transmission  will  not 
only  affect  the  military  attribute  of  the  first  classifi¬ 
cation  system,  but  the  anti-submarine  warfare  attribute 
of  the  second  classification  system  as  well.  The  model  is 
developed  to  recognize  these  interdependencies  and  still 
achieve  an  optimal  resource  allocation  with  consideration 
given  to  other  classification  systems.  Therefore,  category 
support  in  one  system  will  affect  results  in  other  classi¬ 
fication  systems. 

To  apply  linear  programming  techniques  to  the  problem 
of  research  optimization  involved  translating  the  following 


linear  programming  concepts!  maximize  c^X  subject  to  con¬ 
straint  equations  AX  >  b  and  X>0,  where  A  denotes  the 
technology  matrix,  b  denotes  the  requirement  vector,  c^ 
denotes  the  cost  coefficients  and  X  denotes  the  unknowns. 

Symbology  and  definitions  used  in  the  above  trans- 
slation  were  originally  formulated  by  H.  Shaller  [4],  His 
paper  outlined  a  method  of  displaying  an  existing  research 
program  in  matrix  form.  This  report  attempts  to  find  a 
method  of  maximizing  the  results  of  a  research  program  as 
well  as  finding  the  most  effective  way  to  change  the  program 
when  new  conditions  arise. 

In  the  proposed  model,  the  unknowns  to  be  determined 
are  the  amounts  of  funds  to  be  assigned  to  a  category  to 
optimize  program  effectiveness.  These  unknowns  are  denoted 
by  X.  cT  denotes  a  set  of  coefficients  reporting  the  effec¬ 
tiveness  of  a  category  to  the  mission  of  an  organization  per 
research  dollar  invested  in  that  category.  The  term 
category  effectiveness  refers  to  the  amount  of  progress 
made  in  achieving  the  mission  of  the  organization  per  dollar 
input  to  that  category.  Therefore,  cTX  is  the  objective 
function  to  be  maximized. 

To  utilize  the  experience  of  the  research  manager, 
constraint  equations  are  formulated  so  that  the  require¬ 
ments  vector  b  is  composed  of  the  set  of  all  category 
funding  levels.  Each  category  ha3  two  funding  levels. 
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These  funding  levels  are  the  lower  and  upper  bounds  on  the 
amount  of  funds  the  research  manager  desires  to  spend  for  a 
particular  category.  A  lower  funding  level  may  be  computed 
by  determining  the  minimum  amount  of  funds  a  category  must 
receive  if  any  research  is  to  be  accomplished.  An  upper 
funding  level  can  be  chosen  from  a  history  of  past  funding 
to  a  particular  category  or  by  the  research  manager 
evaluating  a  category’s  potential  contribution  to  his 
mission, 

Because  of  formulating  the  constraint  equations  in  this 
manner,  each  element  of  the  technology  matrix  A  takes  on  a 
value,  -1,  1,  or  0.  Therefore,  the  objective  function  is 
maximized  by  selecting  levds  of  category  funding  between 
a  lower  and  upper  funding  level  previously  determined  by  the 
research  manager.  Further  explanation  and  examples  of 
these  concepts  are  found  in  the  sections  titled  Model  Inputs, 
page  (  13  ) . 

The  questions  to  be  examined  in  this  thesis  were 
originally  discussed  by  the  author  with  personnel  of  ONR 
during  a  summer  assignment  there  in  1963. 

These  questions  were  also  posed  in  the  Ad  Hoc  repori 
previously  completed.  They  are: 

1.  What  is  the  effect  of  a  budget  alteration  on  the 
present  research  program?  Can  all  categories  continue  to  be 
supported?  What  activities  must  be  curtailed  or  reduced, 
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and  by  how  much,  to  achieve  optimum  program  effectiveness 
within  this  new  budget? 

2.  If  a  new  category  is  added  to  the  research  program, 
how  must  I  modify  the  existing  program,  What  is  the  optimal 
way  for  this  change  to  be  accomplished? 

3.  What  is  the  effect  of  a  change  of  emphasis  on  the 
program?  How  should  a  reallocation  of  funds  to  accommodate 
this  change  of  emphasis  be  made? 

These  questions  are  not  necessarily  exhaustive.  New 
questions  may  occur  to  the  reader  which  can  be  answered 
by  applying  the  linear  programming  technique. 

To  answer  these  questions  six  problems  were  arbitrarily 
developed.  These  problems  were  solved  with  the  aid  of  the 

V 

CDC  1604  computer  of  the  Naval  Postgraduate  School,  Monterey, 
California.  Because  of  the  tedium  involved  in  applying  the 
linear  programming  technique  to  a  large  problem  and  the 
difficulty  in  inverting  large  matrices,  computers  are 
essential  in  applying  this  method.  Because  computers  must 
be  used  in  the  solution  of  the  problem,  care  must  be  exer¬ 
cised  to  insure  that  the  size  of  the  problem  formulated 
does  not  become  insolvable  due  to  limitations  of  existing 
computers.  The  problems  would  be  unmanageable  if  too  many 
constraint  equations  were  formulated  due  to  a  large  number 
of  categories  in  use.  Grouping  of  categories  might  then 
be  necessary. 
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The  data  used  in  the  sample  problems  of  the  thesis 
are  arbitrary  and  have  no  particular  significance.  The 
first  two  problems  are  maximizations  of  a  program's 
effectiveness  when  two  different  classification  systems, 
identified  as  A  and  B  are  used  to  identify  the  same  research 
program.  The  results  of  these  problems  indicate  the 
allocation  of  funds  which  optimize  program  effectiveness. 
Problem  three  combines  the  A  and  B  system  by  arbitrarily 
adding  their  objective  functions.  The  results  are  not  of 
great  interest  unless  a  research  organization  can  operate 
in  this  manner.  Problem  four  examines  the  effect  of  per¬ 
turbing  the  requirements  vector.  Problem  five,  the  most 
interesting,  and  perhaps  most  useful,  examines  the  effect 
of  optimizing  the  research  effort  of  a  particular  classifi¬ 
cation  system  when  subject  to  the  constraining  influence  of 
another  classification  system.  This  problem  approaches 
realism  to  a  greater  degree  than  do  problems  one  and  two. 
Problem  six  explores  the  effects  of  a  budget  cut  on  the 
research  program,  A  sensitivity  analysis  is  conducted  on 
problem  one  to  evaluate  the  sensitivity  of  the  solution 
obtained  with  respect  to  variations  in  the  input  parameters. 
Detailed  results  were  obtained  for  all  six  problems.  From 
these  results  the  following  general  conclusions  can  be 
drawn : 
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1.  The  linear  programming  model  can  be  of  great 
assistance  in  planning  a  research  program  providing 
a  means  of  evaluating  the  reliability  of  the  input 
data  exists. 

2,  To  assist  in  formulating  the  input  data,  further 
study  is  recommended  into  the  problem  of  quanti¬ 
tatively  measuring  the  output  of  a  research  program. 
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ASSUMPTIONS 


Primary  Assumptions 

For  model  construction  purposes,  it  is  assumed  that  the 
total  research  domain  can  be  divided  into  subdomains  of 
manageable  size,  that  is,  the  number  of  categories  does  not 
result  in  too  many  equations  for  solution  by  present  com¬ 
puter  techniques.  Homcgeneitv  in  the  branches  and 
categories  must  exist  in  order  to  establish  independence 
among  the  linear  equations  to  be  formed.  Homogeneity  can 
be  approximated  through  proper  category  definition.  For 
our  model,  homogeneity  and  manageability  of  the  branches 
'and  categories  are  assumed  to  be  present. 

The  program  managers,  through  judicious  application 
of  management  techniques,  achieve  within-activity  optimi¬ 
zation.  1  This  implies  that  for  a  given  resource  input 
to  a  category,  the  research  manager  will  so  use  his  resources 
that  the  quantity  and  quality  of  research  output  is  opti¬ 
mized,  A  graph  of  the  relationship  between  resource 
input  and  research  output  ^  follows: 


^Rigby,  F.  D.  Activity  Analysis  of  Research  Planning 
in  ONR,  1963. 

^Ad  Hoc  Research  Planning  Committee  at  the  Office  of 
Naval  Research. 
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Upper  threshold  point 


Research  output 


Graph  1 

The  lower  portion  of  the  curve  exemplifies  that  situa¬ 
tion  where  a  research  project  has  just  begun.  In  this  range, 
output  in  relation  to  input  is  low.  Possible  reasons  for 
this  may  be  that  the  group  has  not  "jelled,"  proper  equiD- 
ment  is  not  yet  on  hand,  or  the  problems  themselves  are  not 
completely  formulated.  The  major  portion  of  the  curve  is 
approximately  linear  with  an  unknown  slope.  Here,  the 
assumption  is  made  that  a  large  number  of  workers  adequately 
financed  will  progress  in  a  linear  manner  toward  solution  of 
a  problem.  Research  teams  are  now  organized,  goals  have 
been  set,  and  all  the  inputs  are  now  present  for  problem 
resolution.  This  area  is  the  most  prevalent  one  in  today’s 
research  organizations.  The  upper  portion  of  the  curve 
constitutes  a  region,  of  diminishing  returns  for  resource 


inout.  Such  a  condition  may  occur  when  severe  scientific 
roadblocks,  requiring  a  major  breakthrough  to  clear,  are 
cresent.  An  example  of  such  a  situation  might  be  the 
croblem  of  finding  a  light  but  effective  shielding  for 
nuclear  reactors  to  be  used  Jr.  automotive  transportation* 

A  region  of  diminishing  returns  might  also  occur  if 
adequate  experimental  equipment  or  sufficient  new  scientific 
oersonnel  were  not  available. 

Two  ooints  of  interest,  therefore,  are  the  lower  and 
upoer  activity  thresholds.  An  ability  to  estimate  the 
lower  threshold  point  would  enable  the  research  manager 
to  evaluate  when  a  large  output  return  would  be  imminent 
for  small  resource  input.  Knowledge  of  the  upper  threshold 
point  would  enable  him  to  partially  shift  his  resources  to 
another  category  when  diminishing  output  was  impending. 

An  evaluation  of  these  threshold  points  will  not  be 
attempted  in  this  report. 

Studies  are  presently  being  conducted  to  examine  the 
feasibility  of  measuring  research  output.  As  vet  no  such 
measuring  device  for  ONR  has  been  found,  thereby  necessi¬ 
tating  another  major  assumption.  The  efficiency  of  a 
particular  category  with  respect  to  an  attribute  is  a 
necessary  model  input.  This  efficiency  is  defined  as 
research  output  divided  by  resource  input.  The  sum  of  a 
category's  efficiency  to  all  the  attributes  must  equal  one. 
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Consequently,  estimates  of  category  efficiency  are  entirely 
subiective.  Therefore,  we  must  assume  that  experience  will 
enable  the  project  manager  to  make  a  reasonable  estimation 
of  this  quantity.  This  subjective  estimation  is  a  model 
weakness , 

Secondary  Assumptions 

It  is  logical  to  assume  that  a  certain  level  of  resource 
inout  per  category  is  essential  if  a  meanineful  amount  of 
research  is  to  result.  The  minimum  amount  of  financial 
support  a  category  must  receive  if  orogress  is  expected 
must  therefore  be  established.  It  is  assumed  that  meaning¬ 
ful  research  can  be  accomplished  with  a  minimum  of  one 
unit  of  research  ^  where  a  unit  of  research  is  defined 
as  the  research  input  necessary  to  support  the  average 
research  scientist  for  a  given  time  interval.  For  model 
purposes,  the  time  interval  will  be  one  year.  A  necessary 
lower  bound  on  category  financing,  therefore,  is  the  cost 
of  maintaining  one  unit  of  research  in  a  particular  category. 

The  determination  of  what  constitutes  a  "research 
scientist"  and  the  evaluation  of  his  work  is  entirely 
subjective.  Junior  researchers  may  be  weighted  less 

^Shaller,  H.  I,  An  Exploratory  S'udy  in  Research 
Planning  Methodology,  OUR  Report  ACR/NAR-27,  Sept,  1963. 
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heavily  than  senior  researchers.  Greater  emphasis  may  be 
placed  upon  the  work  of  a  particularly  outstanding  individual. 
By  appropriate  adjustment,  therefore,  the  unit  of  research 
will  be  used  as  the  least  common  denominator  for  all  quanti¬ 
tative  arguments. 

For  purposes  of  simplicity,  the  proposed  mode}  will 
not  include  those  conditions  where  financing  is  done  over 
a  period  greater  than  one  year.  If  these  constraints  are 
desired  for  practical  application  purposes,  they  may  be 
formed  as  yearly  ratios  and  included  in  the  >  rray  of 


CONSTRAINTS 


Optimization  of  the  research  effort  is  defined  as  that 
set  of  resource  allocations  which  achieves  the  greatest 
effectiveness  under  a  given  set  of  constraining  conditions. 
Constraining  conditions  are  essentially  those  bounding  factors 
which  the  research  manager  desires  to  be  considered  in  the 
overall  solution  to  his  problem.  The  restrictions  to  be  dis¬ 
cussed  are  budget  constraints,  balance  constraints ,  and 
threshold  constraints. 

Budget  constraints  consist  of  those  limits  superim¬ 
posed  on  the  research  program  by  monetary  considerations. 

These  budgetary  allocations  may  be  presented  in  a  number  of 
forms;  as  a  single  ceiling  under  which  the  research  manager 
must  conduct  his  entire  program;  as  a  series  of  budget 
ceilings  placed  on  individual  branches  or  categories.  In 
the  former  case,  there  exists  essentially  one  bound,  while 
the  latter  example  contains  constraints  equaling  the 
number  of  categories  individually  budgeted. 

A  threshold  constraint  might  be  defined  as  the  minimum 
resource  allocation  to  a  category  necessary  to  conduct 
meaningful  research.  It  has  been  previously  assumed  that 
meaningful  research  can  be  accomplished  with  a  minimum  of 
one  research  unit,  therefore  the  threshold  constraint  per 
category  is  the  cost  of  maintaining  a  research  i  nit  in  a 


particular  category.  The  expression  "meaningful  research" 
is  subjective.  As  there  does  not  exist  a  measuring  device 
for  research  output,  the  "one  unit  of  research"  critei ia 
was  chosen  essentially  by  experience.  Therefore,  the  cost 
criteria  for  "meaningful  research"  can  be  chosen  arbitrarily. 


MODEL  INPUTS 
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MODEL  INPUTS 


Five  items  will  be  discussed  as  inputs  to  the  model, 
of  which  two  are  constants,  two  are  subjective  variables, 
and  one  is  a  subjective  constant. 

CONSTANTS 

A  total  and  fixed  budget  over  a  yearly  interval  must 
be  specified.  This  budget  may  later  be  influenced  by  the 
conclusions  drawn  from  model  results,  but  a  fixed  amount 
of  dollars  for  research  ourposes  must  initially  be  deter¬ 
mined.  The  total  budget  for  ONR  is  determined  within  the 
Defense  Deoartment.  X  will  denote  the  total  budget. 

As  Dreviously  noted,  a  unit  of  research  is  defined 
as  the  resource  inout  necessary  to  support  the  average 
research  scientist  for  one  year.  The  cost  of  a  unit  of 
research  will  naturallv  vary  widely  among  different 
categories,  depending  UDon  the  area  of  investigation. 

A  research  scientist  engaged  in  subatomic  narticle  study 
might  require  the  use  of  highly  sophisticated  equipment 
while  a  mathematician  investigating  a  theorem  might  need 
only  pencil  and  paper.  Cost  oer  research  unit  in  a  parti¬ 
cular  category  might  also  include  such  items  as  floor  space, 
supporting  personnel,  salaries,  and  overhead.  The  total 
cost  ner  research  unit  in  the  ith  category  will  ;  e  denoted 
bv  K ( ) ,  20 


SUBJECTIVE  VARIABLES 


The  overall  mission  of  an  organization  is  clearly  speci¬ 
fied  in  terms  of  such  attributes  as  maximization  of  orofits, 
maximization  of  military  might,  or  maximization  of  research 
nroeress,  After  breaking  down  a  specific  organizational 
mission  into  its  attributes,  a  decisio:  must  be  made  as  to 
what  emphasis  is  to  be  nlaced  on  each  attribute.  The 
emehasis  factors  will  be  in  percentage  form,  with  their 
sum  equal  to  one  hundred  percent.  The  decision  as  to  what 
contribution  an  attribute  is  to  make  to  the  overall  mission 
will  originate  from  the  upper  levels  of  an  organization. 

The  direction  a  research  organization  will  take  is  now 
determined.  C(Aj )  will  denote  the  contribution  of  the 
jthattribute  to  the  overall  mission. 

Another  model  input  is  the  approximate  emphasis  that 
is  to  be  placed  on  each  category.  This  factor  may  be 
determined  from  study  of  the  history  of  the  organization, 
from  an  estimate  of  the  importance  of  a  particular  category 
to  the  overall  mission,  or  from  empirical  observation. 

This  decision  would  usually  be  made  at  a  lower  organiza¬ 
tional  level--an  ONR  by  the  department  heads.  These 
estimates  are  to  be  assigned  in  bracket  form.  For  example, 

10  to  15  oercent  might  be  assigned  to  category  one,  and 
30  to  40  percent  to  category  two.  Care  must  be  taken  to 
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insure  that  the  sum  of  the  lower  estimates  is  less  than  100 
Dercent  and  the  upper  estimates  sum  to  greater  than  100 
percent.  W(C^)  will  denote  emphasis  to  be  placed  on  the 
i**'  category. 

SUBJECTIVE  CONSTANT 

The  efficiency  or  progress  a  category  contributes  to 
an  attribute  has  previously  been  discussed  in  the  section 
titled  ASSUMPTIONS .  The  project  manager  must  decide  what 
contribution  his  category  makes  to  a  particular  attribute. 

The  sum  of  these  percentages  must  equal  one  hundred.  The 
degree  of  difficulty  in  making  such  a  decision  will  naturally 
vary  with  each  category.  A  category  such  as  propaganda 
obviously  has  a  large  preponderance  of  military  rather 
than  scientific  value.  A  project  manager  concerned  with  the 
propaganda  category  may  decide  therefore  that  15  percent 
of  this  category  contributes  to  attribute  one,  60  percent 
to  attribute  two,  and  25  percent  to  attribute  three.  It  is 
recognized  that  this  subjective  estimate  may  at  times  be 
very  difficult  to  make.  Progress  contributed  by  the  ith 
category  to  the  jth  attribute  will  be  denoted  by  P 
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MODEL  INPUTS 


1. 

X  -  total  budget 

2. 

C(Aj) 

-  Contribution  of  the  attribute  to  the  overall 

mission , 

! 

3, 

W(C  -  ) 

-  Emphasis  placed  on  the  itln  category 

4  . 

pii  - 

t  fa 

Progress  contributed  by  the.  i  category 

to  the  jth  attribute  per  dollar. 

relative 

5. 

K(Ci) 

-  Total  cost  per  unit  of  research  in  the 

ith 

category. 

K(CL)  is  expressed  as: 


K(Cj)=  a-z.+  b-v.+  c-w-+  d • v ■ . . • 

1  i  l  11*  11  ijrii 


where  : 


cost 

scientist  year 

scientist  year 
unit  of  research 

cost 

unit  of  personnel 

unit  of  personnel 
unit  of  research 

cost 

sq, ft .  of  office  space,  lab  space... 

sq.ft,  of  space  required 
unit  of  research 

cost 

unTt  of  equipment  required 

piece  of  equipment  required 
unit  of*  research 


9.  Scientist  year  --  unit  of  research 
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MODEL  OUTPUTS 
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MODEL  OUTPUTS 


Direct  Output 

After  consideration  of  the  inputs  previously  discussed, 
the  model  indicates  the  amount  of  resources  to  be  allocated 
to  each  category.  ■  The  resource  allocation  to  the  ith  category 
will  be  noted  x^ . 


Computed  Output 

Upon  arriving  at  a  set  of  optimal  resource  allocations, 
certain  additional  quantities  may  be  of  interest.  These 
values  will  be  displayed  in  matrix  arrays  as  formulated  by 
H.  Shaller  in  An  Exploratory  Study  in  Research  Planning 
Methodology.  [4 ] 


COMPUTED  MODEL  OUTPUTS 

1.  u.  s  Number  of  research  units  in  the  ith  category. 

2.  t  "-i-soy.  of  research  units  in  the  i*“  category 

corresponding  to  the  jth  attribute. 

3.  E;.»  s  Effectiveness  of  the  ith  category  relative 

J  to  the  j'th  attribute  to  the  overall  .  ission. 

4.  E^a  *  Effectiveness  of  the  i**1  category  relative  to 

all  the  attributes  per  research  unit. 

5.  E{  =  Effectiveness  of  the  ith  category  relative  to 

all  the  attributes  per  research  unit. 

6.  C  =  Total  effectiveness  of  the  research  program, 

7.  L(Bi  )=Emphasis  resulting  on  the  j**1  goal  of  the  B 

classification  system. 
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NOTATION 
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l  • 

Ci 

r 

The  ith  category. 

l 

2  . 

Ai 

= 

The  ith  attribute. 

3. 

C(Aj 

)  = 

Contribution  of  the  attribute  to  the  overall 

mission . 

*+ . 

xi 

- 

Resource  allocation  to  the  i"1*1  category. 

5. 

X 

s 

Total  resources. 

6. 

= 

Cost  per  research  unit  in  the  i^  category; 

7. 

ui 

= 

Number  of  research  units  in  the  i^h  category. 

8. 

uij 

= 

Number  of  research  units  in  the  i-^  category 
corresponding  the  the  attribute. 

9. 

i' 

= 

Total  number  of  research  units  accomplished. 

10. 

Po 

= 

Progress  contributed  by  the  ith  category 
relative  to  the  attribute  per  dollar 

11. 

Eii 

s 

f 

‘Effectiveness  of  the  it*1  category  relative  to 
attribute. 

the 

12. 

Eia 

s 

Effectiveness  of  the  i^*1  category  relative  to 
the  attributes. 

all 

13. 

E 

= 

Total  effectiveness  of  the  research  program. 

14  . 

w(Ci 

)  = 

Emphasis  placed  on  the  ith  category. 

15. 

Ei 

= 

Effectiveness  of  the  i^*1  category  relative  to 
all  the  attributes  per  research  unit. 

16. 

E<Bj 

)  = 

Emphasis  resulting  on  the  C^al . 

i  - 

(1, 

2 ,  ..i.m)}  h  -  ( 1 |  2 ,  , . . . n ) 

L 


MATHEMATICAL  DEFINITIONS  AND  BASIC  EQUATIONS 


1. 


^lC(A,)  =  l 

j'>  J 

W(Ct)  =  l 


1. 

2. 


jr  x.  -X 

l*i  i 

ui=  xi 


) 


MODEL  INPUT  RESTRAINTS 


MODEL  OUTPUT  DEFINITIONS 


3. 

EW 

=  Piy  C  (  A 

4. 

Eut 

=  uiEt 

5. 

*iE-j 

6. 

E=  . 

i 

7. 

E(B 

2-,  <*< 

8. 

U«J 

=  Py  uc 
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SAMPLE  PROBLEMS 
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SAMPLE  PR03LEMS 


A  Brief  Description 

Six  sample  problems  have  been  constructed  to  evaluate 
the  model.  The  data  used  are  arbitrarily  collected  and  have 
no  particular  significance.  Problems  one  and  two  are  maxi¬ 
mizations  of  different  classification  systems  (called  A  and  B) 
and  describe  identical  research  programs.  These  two  classi¬ 
fication  systems  are  initially  considered  to  be  independent 
of  one  another.  Their  interdependence  is  examined  ■  .  oblem 
five.  Problem  three  experimentally  combines  the  A  ai.i  3 
systems  by  arbitrarily  adding  their  functional  equations. 
Problem  four  examines  the  effect  of  varying  the  range  width 
of  the  WCC-ps  on  the  outcome  of  problem  three.  Problem  five 
treats  the  B  classification  as  an  additional  constraint 
equation  of  problem  one*  and  maximizes  this  new  problem. 
Problem  six  examines  the  effect  of  a  budget  reauction  on 
the  optimum  allocation  of  resources  to  the  categories.  To 
evaluate  the  sensitivity  of  the  solution,  a  sensitivity 
analysis  was  conducted  on  the  input  parameters  of  oblem 
one.  All  problems  were  solved  with  the  aid  of  a  CDCI604 
Computer,  A  discussion  of  the  results  of  all  problems  is  con¬ 
tained  in  the  conclusions. 
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General  Discussion  for  Problems  One  and  Two 


Problems  one  and  two  maximize  the  effectiveness  of  the 
identical  research  program  by  means  of  two  assumed  independent 
classification  systems  (called  A  and  B).  The  data  used  in 
both  problems  were  arbitrarily  collected  and  are  without 
particular  significance,  The  interrelationship  between 
these  two  problems  is  treated  in  problem  five. 

Objective  functions  and  constraint  equations  are 
developed  for  both  problems  and  solutions  are  then  obtained 
by  using  linear  programming  techniques.  An  investigation 
for  alternate  solutions,  and  a  sensitivity  analysis  is 
conducted  on  problem  one. 

The  model  inputs  previously  discussed  will  now  be 
tabulated  in  matrix  format  as  developed  by  H.  Shaller  [5]  is: 


C(.  i  '  C(A2>. . .  ,c(An) 


K(C1) 

W(C  x) 

Pll 

P],2  ♦  •  •  • 

•Pin 

K(C2) 

• 

• 

W<C2) 

• 

• 

p-21 

• 

• 

p > 2 

* 

• 

•  P  ’n 

n_ 

-PfliL. 

P|W\ 

Table  1.  Data  display  using  a  matrix  format 
where  X  =  total  budget 


30 


Problem  one  Maximization  of  the  A  classification  system 


33  .02 


. 060-. 090 
.130-. 156 


.024-. 054 


•1  For  this 
problem 

•1  arbitrarily 
take 

.1  X=  895,300 
dollars, 

•  1 

0  For  simpli= 
city  k(Ci> 

,1  has  been 

chosen  a  con 
.1  stant  value 
of  fo  ty 
,1  thousand 
dollars, 


.010-. 012  0  .9  0  0 

.064-. 084  0  1.0  0  0 

.132-. 360  .2  .5  .1  0 

.012-. 012  .5  .1  .1  0 

.100-. 108  .2  .3  .2  .1 

.240-. 340  .1  .6  .2  .1 

.100-. 128  .1  .6  .2  .1 

Table  2.  Input  Data  to  Problem  One 


Objective  Function 

The  total  effectiveness  of  the  research  program  is 
definted  to  be: 

E,lr.  =  ^  £  t.  i:  =.£  2.  CCAjUi. 

For  Problem  one,  therefore,  the  objective  function  to  be 
maximized  is: 

E  = _1_ (.399x,+.240  x,  +  .262  x,+  .471  x,+  .521  x^+,311  x^ 
A  IfQ  5 

*  .145  X?  t  -23V  Xa  +  .3 72)(,+  .?72X/0) 

where  the  coefficient  for  x,  is  determined  from  the 


relationship 


jS-  PijctAP 


Accordingly : 


(.1)C.130)*(.7)(.521)+(.1)( ,194)+(.l)(.020)s.399 
Constraint  Equation  Format 

The  constraint  equations  are  determined  from  the 
W(C^)  data.  Also 

7^  -  W  (C't) A 

'4 

where  •^-X;=  895.3  thousand  dollars 

is  i  ‘ 


X|  (in  thousands  of  dollars) 

53.7  i  X,  L  80.6 
116.3  fX2fJ.39.9 

21.5  k  48.4 
8.9  4X^4  10.8 

57.5  4  75.5 

118.2  *  *£$  322,3 

10.8  k  X74  10.8 

89.5  &  Xg4  96.7 
214.9  £  ^4304.4 

89.5  *X,£ll4.6 


The  objective  function  developed  for  problem  one  can  now 
be  maximized  subject  to  the  above  linear  constraint  equations 
by  standard  linear  programming  techniques. 


Results  of  Problem  one 

Table  3  displays  various  quantities  that  may  be  of 
interest  to  the  research  manager.  Column  one  indicates 
the  support  a  category  should  receive  for  maximum  effective 
ness  in  the  research  program.  The  total  number  of  research 
units  contributed  by  the  i^h  category  to  the  program,  , 
is  obtained  by  dividing  by  the  cost  of  a  research  unit 
of  the  ith  category,  K(Cj_).  may  be  broken  down  into  the 

number  of  research  units  which  correspond  to  a  particular 
attribute  by  the  relationships 


Therefore  s 


i 

xi 

«i 

A2 

a3 

\ 

A5 

A6 

1 

80.6 

2.02 

.20 

1.41 

.20 

0.0 

.20 

2 

116.3 

2.91 

.29 

.  87 

.  87 

.29 

.29 

.29 

3 

21.5 

.54 

.11 

.16 

.23 

.05 

B 

10.8 

.27 

0.00 

.25 

0.00 

.02 

ffl 

75.5 

1.  89 

0.0  D 

1.89 

0.00 

,0.00 

0.00 

118.2 

2.96 

.59 

L  48 

.29 

.29 

B 

10.8 

•2  7 

.13 

.03 

.03 

0.00 

.05 

.03 

8 

89.5 

2.24 

.45 

.67 

.45 

.22 

Hfe 

.23 

282.6 

7,07 

.71 

4.  24 

1.41 

.71 

0.00 

89.5 

2.24 

.22 

1.24 

L  45 

.22 

0.00 

Table  3  -  The  u^-  array  distribution  of  units  of  research 
versusJ dollar  input. 
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Three  other  quantities  may  be  of  interest  to  the 


research  manager.  They  ares 

=  Effectiveness  of  the  ith  category  relative 
to  the  j*11  attribute  and  is  defined  by 

^ij  =  Pij 

=  Effectiveness  of  the  i^  category  relative 

to  all  the  attributes  per  research  unit  and 

is  defined  by 
/  n 

EL  £  lj 

=  Effectiveness  of  the  i"*-*1  category  relative 


Eij 


b.  E| 


c. 


la 


Therefore ! 


to  all  the  attributes 

£  t ™  u.^  ^ j, 


and  is  defined  by 


ID 


Total  system  effectiveness  =  E  7,97  units 

This  method  of  displaying  data,  (H,  Shaller  [4])  indi« 
cates  how  much  a  category  contributes  to  a  particular 
attribute.  Thus  category  four  has  the  greatest  contri¬ 
bution  to  attribute  two,  An  increase  in  emphasis  on 
Attribute  two  may  possibly  be  accomplished  by  increased 
support  to  category  four. 


Alternate  Solution  to  Problem  one. 


fl 


As  two  solutions  exist  to  problem  one,  any  convex 
combination  of  these  solutions  will  maximize  this  problem, 
as  given  under  column  heading  of  General  Solution, 


Sensitivity  Analysis  of  Problem  One; 

A  sensitivity  analysis  was  conducted  on  problem  one 
to  determine  the  extent  of  dependence  of  the  solution  upon 
the  input  parameters.  Standard  Linear  programming  proced¬ 
ures  were  used  to  determine  this  dependence.  The  results 
are  as  follows: 

A.  Sensitivity  of  the  coefficients  in  the  objective  function. 

After  completing  the  linear  programming  procedures,  it 
was  found  that  the  following  relationship  among  the  co¬ 
efficients  must  exist  if  an  optimal  solution  is  to  be 
maintained. 

Equation  1  p'  f'  *  c'  ?  p'  p'_  p'  p '  p '  P  ' 

where:  in  the  sample  problem: 


E,  =  .399 
Ej  =  .240 
Ei  =  .260 


E„  =  .471 


E6  =  .311 
E*  =  .145 
Z't  =  .235 
Zq  =  .372 


Therefore  the  solution  is  most  sensitive  to  an  increase 

.  *  #  1  /  ,  , 
in  Elo  and  Eb  and  to  a  decrease  m  E,  .  As  E  b  is  defined 

as  ^  =  J?  EHi  =  ^Pvic^Ai) 
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Changes  in  the  (A^ )  can  now  be  examined.  As  was  previously 
noted  under  Model  Inputs,  the  contribution  an  attribute  is 
to  make  to  the  overall  mission  will  originate  from  the 
upper  levels  of  an  organization.  Changes,  therefore,  that 
do  not  affect  equation  one  -ill  not  change  the 

optimality  of  the  solution  previously  attained.  If 
equationlis  no  longer  true,  however,  the  problem  must  be 
re-run . 

To  investigate  the  reliability  of  the  solution,  the 
research  manager  would  be  interested  in  noting  the  effect 
of  varying  the  UDon  the  solution.  An  example  of 

this  is: 

ExamDle 


cca} 

.130 

.521 

.194 

.094 

- 1 

.033 

;  0  0  2  0 

A1 

a2 

A3 

a4 

A5 

a6 

Original  p  —  s  for 
category  six 

.2 

.5 

.1 

0 

.1 

.1 

New  p^ • ’ s  for 
category  six 

.3 

.4 

0 

.1 

.1 

original  e£=.3H 

new 


Consequently,  optimality  is  still  maintained. 

/  i 

As  E/e>  *  Eq  increase  p^g  2  at  the  expense  of  any 
other  p,  .  would  clearly  change  the  optimal  solution. 
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B.  Sensitivity  of  the  W ( > s 


Let  W(C^)  upper  bound  be  denoted  by 
W(C^)  lower  bound  be  denoted  by 
The  ontimal  solution  is  maintained  providing  the 
following  relationship  exists. 

Equation  (2)  b^ 

where  B=b,  +  b^  +  b?  +bft+bk<-t'ba.  +bfc  +b7  +b/p  =  612.7 
and  where  X  =  total  budget  =  $895,300. 

In  problem  one  this  relationship  is 

5  90  >  9  £  612.7  £  680.4 

Therefore;  a  change  in  the  W(C^)  that  leaves  equation  (2) 
unchanged  will  not  affect  the  optimality  of  the  solution. 

Example 


origins]  t<j  = 

214.9  new  Ijq  = 

254.9 

7  5.5  S*  = 

95.5 

10.8  b4  = 

20.8 

Therefore  B  =  642. 

7  X-b^  =  640. 

4 

B  is  not  less  than  X  -  b^ and  the  problem 

must  be  rerun. 


Problem  Two 

Problem  two  is  formulated  so  that  the  W(C^)s  and  the 
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}(C^)’s  are  the  same  as  that  of  problem  one*  A  comparison 
of  category  emphasis  between  these  two  problems  can  then 
be  made*  A  new  classification  system  is  used  which  con¬ 
sists  of  three  attributes  instead  of  the  seven  used  in 
problem  one*  The  d^s  and  the  C(B^)s  will  therefore  not 
be  identical  to  those  used  in  the  previous  problem*  The 
classification  system  used  in  problem  two  will  be  denoted 
as  the  B  system* 


Therefore:  DATA 

- C(B<> 


W(C.  ) 

.363 

.510 

.120 

, 060- „ 090 

.25 

.55 

.  2 

,130-. 156 

.4 

.3 

*  3 

*  0  2  4  -  .  0  6  4 

0 

0 

0 

.C10-. 012 

0 

0 

0 

. 064- -  084 

0 

0 

0 

►-* 

1 

U> 

<T 

O 

*57 

,43 

0 

. 01 2  - .  0 1  ? 

.5 

*5 

0 

*100-. 108 

1.0 

0 

0 

*  ? 4  0  -  r.  340 

.10 

.85 

.05 

,100-. 1?8 

.10 

*  85 

*05 

X-  895,300  dollars 


K(C± )  =  40,000  dollars 


Table  6*  Input  data  to  problem  two* 


Objective  function  for  problem  two; 


pL  jC(Bj) 
Jr/  K i(Ci)  J 


«L  [.395xf-»  =  334xx+,426  X  +  .437  x?  +  ♦o477x£> 

4o 

+,477x1 

to 

Coefficients  for  X3 ,  X4 ,  X5 ,  equal  zero 
System  of  constraint  equations  for  problem  two. 

Same  as  that  of  problem  one. 


Results  of  Problem  two. 

The  results  of  problem  two  are  disDlayed  in  tables 
seven  and  eight.  Column  one  in  table  seven  indicates  the 
support  a  category  should  receive  for  maxim  n  effectiveness 
in  the  research  program,  using  this  particular  classifi¬ 
cation  system,  is  again  calculated  from  the  definition; 

ui  =  xi  _ 
k  (  ^i" ) 

Columns  four  through  six  indicate  the  u^jS  for  the  B 
classification  system.  Columns  seven  through  twelve  indicate 
the  u^j  values  for  the  A  classification  system  of  problem 
one,  using  the  x^  values  of  problem  two.  An  example  of 
the  effect  of  using  the  values  of  problem  two  on  the 
A  system  is  the  decrease  of  u^  from  .20  to  .13  while  U61 
increased  from  .59  to  .72,  As  expected,  changin;  riw;  level 
of  category  supDort  will  affect  the  amount  a  category 
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contributes  to  a  particular  attribute  and  to  the  entire 
program.  Table  eight  is  computed  in  an  identical  manner 
to  that  of  table  three  in  problem  one,  Columns  one  through 
three  indicate  the  E^j  of  the  B  system,  Columns  four  and 
five  display  and  Ea  respectively.  Column  six  is  the 

new  E^a  of  the  A  system  when  using  the  category  supports 
of  the  B  system.  An  example  of  the  change  in  Eia  of  the 
A  system  is  the  decrease  in  E^a  from  ,806  to  ,668, 


OPTIMIZATION  OF  "B"  CLASSIFICATION  SYSTEM 


i 

Ui 

X 

X 

T?2 - 

■*5“ 

a2 

‘*T“ 

A6 

1 

1.34 

53.7 

.34 

.74 

.26 

.13 

.94 

.13 

0.00 

0.00 

,13 

2 

2.91 

116,3 

1.16 

.872 

.87  3 

.29 

.87 

.87 

.29 

,29 

.29 

3 

.54 

21.5 

0.00 

0.00 

0.00 

.11 

,16 

.23 

0.00 

0,00 

.05 

4 

.23 

8.9 

0,00 

0.00 

0.00 

0.00 

.21 

0,00 

0,00 

0.00 

.02 

5 

i  ,4  4 

57.5 

0.00 

0.00 

0.00 

0.00 

L  44 

0.00 

0.00 

0.00 

0.00 

6 

3.58 

14  3.2 

2.04 

1.54 

0.00 

.72 

L  79 

.  3  6 

0.00 

.36 

,  36 

7 

.27 

10.8 

.13 

.14 

0.00 

.13 

.03 

.03 

0.00 

,05 

.03 

8 

2.24 

89.5 

2,24 

0.00 

0,0  0 

.45 

.67 

.45 

.22 

.22 

.23 

9 

7.61 

3  04,4 

.76 

5.07 

.3 

.76 

4.5  7 

1.52 

.76 

0.00 

0,00 

L0 

2.?u 

89,5 

'.76 

1,90 

.11 

.22 

1.  34 

.45 

.22 

0.0(! 

0.00 

Table  7.  The  arrays  distribution  of  units  of  research 
versus3 dollar  input 
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,10  8 
.145 

1  0.00 
'*  0.00 

5  0.00  0.00  0,00 

6  .206  .719  0,00 

7  .181  ,255  0.00 

9  .361  0.00  0.00 

9  .036  .434  .006 

10  .036  ,434  .006 


KH 

Lia 

.  395 

.529 

.  334 

.972 

0.00 

0,00 

0.00 

0,00 

0.00 

0.00 

.426 

1.52  5 

.4  37 

.  117 

.  363 

.813 

.476 

3,622 

.476 

1.066 

A.  svstera  E 


o  S 34 


698  Total 

Effect- 
141  iveness 


~  8.fc2u*rhs 


.109 
.750 
1.114 
,  0-3  9 
,523 


2.830  New  E^*  7. 57 uw  rts 


Table  8,  The  effectiveness  matrix  versus  categories. 

Table  9  indicates  the  results  of  applying  the  optimum 
set  of  category  supports  obtained  in  the  A  system  of  problem 
one  to  the  13  system  of  problem  two.  Using  the  x^^  oi 
problem  one,  therefore,  we  obtain: 


Graph  2.  Dollar  input  v_  Category:  A  comparison  of 
the  results  of  the  A  and  B  classification 
systems  in  problem  one  and  two  respectively. 


A  -  classification 
k  system  (optimized) 

B  -  classification 
D  system  (optimized) 
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Problem  III 


The  A  and  B  classification  systems  were  combined  by 
arbitrarily  adding  the  like  components  of  their  functional 
equations  to  determine  the  relationship,  if  any,  between 
this  problem  and  problems  one  and  two.  The  resulting  problem 
was  to  maximize  the  equation: 

.  V48xj  +  .  574  x4+.  262  x^  +  .  471xM+  .  521  .737  x*+,581  x7 

+  .  597  xfl+  ,.849  Xy+  ,  849  x/0 
Results  of  Problem  III 


* 

k^  =  40.0  for  all  x 

u^  =  Number  of  research  units  in 
the  ith  category 

Total  effectiveness:  16.23  units. 


Table  10.  Results  of  problem  three,  maximization  of 

function  determined  by  summing  corresponding 
components  of  A  and  B  classification  systems. 


X1 

53.7 

1.34 

x2 

116.3 

4.07 

x3 

21.5 

.54 

X4 

3.9 

.23 

x5 

57.5 

1.44 

x6 

118.2 

2.96 

x7 

10.8 

.27 

x8 

89.5 

2.24 

x9 

304.4 

7.61 

Ho 

114.5 

2.86 

Dollar  Input 


Classification  Systems 


Low  High  A  B  A+B 


S  -  same 
H  s  high 
L  =  low 

From  the  results  indicated 
indicated  in  table  8,  no 
particular  relationship  can 
be  discerned  between  problem 
three  and  problems  one  and  two 


Table  11:  A  comparison  of  values  which  maximized 

effectiveness  of  the  A,  B,  and  A4B  class!- 
cation  systems. 


Problem  4 

In  some  instances  a  larger  degree  of  uncertainty  may 
exist  on  the  part  of  the  research  manager  concerning  the 
range  of  separation  between  the  lower  and  upper  bounds 
of  a  category.  Therefore,  problem  four  was  run  to  note 
any  effect  on  the  results  of  problem  three  by  initially 
choosing  a  wider  range  of  category  emphasis  bounds. 

Accordingly,  the  W(C^)s  of  problem  three  were  varied 
by  increasing  the  range  between  the  lower  and  upoer  bounds 
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of  each  category.  The  lower  and  upper  bounds  were  lowered 
and  raised  respectively  by  equal  amounts  for  all  categories. 
Maximization  of  problem  three  with  respect  to  these  new 
constraint  equations  was  then  performed.  The  bounds  were 
varied  in  this  manner  four  times,  with  the  results  indicated 
in  table  12. 
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PROBLEM  TV 

1  2 -  3  4 


mr* 

HTgh 

LOW - 

HTBH — 

'~rm — 

~ETTCTT~ 

TOT — 

HKH 

1 

uS.'i 

5TT7S 

33.7 

~  13 . 7 

14  5.6 

2 

106,3 

149.3 

96.3 

159.9 

76.3 

179.9 

56.3 

199.9 

3 

11.5 

58.4 

0.0 

68.4 

0.0 

88.4 

0.0 

168.4 

4 

3.S 

21.8 

0.0 

31.8 

0.0 

51.8 

0.0 

71.8 

S 

47.5 

85.5 

37.5 

95.5 

17.5 

115.5 

0.0 

135.5 

6 

108.2 

332.3 

98,2 

342.3 

78,2 

362.3 

58.2 

382.2 

7 

0.0 

20,8 

0.0 

30.8 

0.0 

50.8 

0.0 

70.8 

8 

79.5 

106.7 

69.5 

116.7 

49.5 

126.7 

29.5 

146.7 

9 

194.9 

324.4 

344.4 

154.9 

364.4 

10 

29.5 

174.6 

Total  Effectiveness 
Problem 

12  3  4 

rrr^? — tett7 — rrrrs — rrrrr 


PROBLEM 


I 

- 1 

4 

H 

H 

H 

H 

L 

L 

L 

L 

L 

L 

L 

L 

L 

L 

L 

L 

L 

L 

L 

L 

117. 

0126.4 

126 

.4123 

L 

L 

L 

L 

L 

L 

L 

L 

H 

H 

H 

H 

H 

H 

H 

!.- 

Table  12s  Comparison  of  value  choices  of  four  runs  after 
varying  W(C^)  intervals. 
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Problem  5 


Since  the  research  manager  is  usually  confronted  with  a 
situation  in  which  his  categories  simultaneously  emphasize 
attributes  of  different  classification  systems,  the  model 
is  more  realistic  when  classification  systems  are  coupled. 
Problem  5  was  run  to  determine  what  relationship  exists  when 
two  classification  systems,  A  and  B,  of  problems  one 
and  two,  respectively,  are  combined. 

Therefore,  a  solution  was  obtained  to  the  problem  of 
maximizing  the  A  classification  systenfs  objective  function 
using  the  object  function  of  the  B  system  as  an  additional 
constraint  equation.  Values  chosen  for  the  B  system  function, 
while  acting  as  a  constraint  equation  for  the  A  system, 
ranged  from  its  maximum  value  of  343.69  (obtained  from 
problem  two)  to  332.0.  The  lower  value,  332.0,  was 
determined  by  evaluating  the  B  system  function  with  respect 
to  thost  x  values  which  had  maximized  the  A  system.  The 
results  of  problem  five  are  displayed  in  table  13  and 
graoh  3 , 
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x  Output 


system  constraint  equations 


Problem  6 


Problem  six  investigates  the  effects  of  a  budget  cut, 
a  oroblem  sometimes  encountered  by  the  research  manager., 
After  maximizing  oroblem  five,  part  five,  the  total  budget 
was  cut  from  $395,300  to  $825,300,  The  effects  of  the 
budget  decrease  on  the  optimal  solution  of  the  problem  are 
displayed  in  table  14,  Care  was  taken  in  choosing  the  new 
total  budget  to  remain  above  the  sum  of  the  lower  budget 
limits  of  all  categories. 

Original  budget  -  $£95,300  Mew  budget  -  $825,300 
X,-  values 

~~  '  Optimum  category  revised  optimum 
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CONCLUSIONS 


CONCLUSIONS 


In  the  introduction,  various  questions  were  raised  that 
were  of  interest  to  the  research  manager.  An  examination 
of  the  results  of  the  six  problems  and  the  sensitivity 
analysis  enables  us  to  answer  these  questions. 

Results  of  problem  one  reveal  several  facts  that  are 
in  agreement  with  intuition.  After  examination  of  the 
column,  (page3H),  emphasis  would  intuitively  be  placed  on 
C5 ,  C4 ,  Cl,  C9,  and  the  remaining  categories  in  order  of 
their  descending  amounts.  The  intuitive  allocation  method 
would  emphasize  those  categories  which  contributed  the 
greatest  amount  to  the  research  program,  per  unit  of  re- 
search.  The  upper  values  of  these  categories  should  always 
be  chosen  in  descending  order  of  their  contribution  until  a 
point  is  reached  in  the  allocation  process  that  necessi¬ 
tates  a  shift  to  the  lower  bounds  of  the  remaining  categor¬ 
ies.  This  emphasis  shift  would,  of  course,  be  necessary 
in  order  for  the  program  to  remain  within  the  total  budget. 

The  results  of  the  linear  programming  technique  on  problem 
one  were  in  agreement  with  those  derived  from  the  above 
intuitive  considerations. 

Problem  one  has  an  alternate  solution.  However,  this 
situation  cannot  always  be  expected.  An  interDretation  of 

this  situation  is  that  the  research  manager  has  an  alternative 
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program  he  may  follo.^and  still  achieve  optimum  results. 

In  this  problem,  re^our  "les  have  been  shifted  from  C9  to 
CIO,  resulting  in  maximum  emphasis  on  this  category. 
Actually,  any  convex  combination  of  these  two  solution 
sets  would  also  be  optimal.  An  alternate  solution  would 
also  be  advantageous  in  possibly  increasing  the  effective¬ 
ness  of  other  classification  systems.  Thus,  if  greater 
emphasis  is  desired  placed  upon  an  attribute  of  another 
classification  system  no  loss  in  program  effectiveness  need 
occur.  A  shift  to  the  alternate  solution  might  increase 
the  emphasis  on  this  attribute  while  still  maintaining 
the  same  maximum  effectiveness  as  before. 


The  reliability  of  any  output  is  determined  to  a 
great  extent  by  the  sensitivity  of  the  results  on  the 
input  parameters.  In  the  sensitivity  analysis  conducted 
on  problem  one,  the  results  (page 36)  indicate  that 
category  nine  is  of  major  importance.  Examination  of  these 
data  indicates  that  the  solution  of  the  problem  is  most 
sensitive  to  changes  in  categories  10,  6,  and  1,  in  that 
order,  and  fairly  insensitive  to  changes  in  the  other 
coefficients.  With  this  information,  emphasis  changes 


in  the  C(A^)  can  now  be  analyzed. 

As  each  cost  coefficient  is  derived  from  the  equation 
E^  =  uncertainty  in  the  exact  value  of  p^j  may 
affect  the  ordering  relationship  above  and  thus  affect  the 


.  Assuming  our  values  of  p-^  are  reliable,  a  change 


solution 


in  the  C(A^)  that  does  not  affect  the  ordering  relationship 
of  the  categories,  will  not  change  the  existing  program. 

Examining  the  analysis  of  the  W(C^)s,  several  interest¬ 
ing  facts  emerge.  All  categories  except  category  nine  have 
one  bound  that  has  no  effect  on  the  solution,  The  low^r 
bound  on  category  one  and  the  upper  bound  on  category  two 
are  examples  of  this.  Category  nine  is  the  exception,  as 
is  indicated  by  the  results.  If  a  shift  in  category 
emphasis  is  however  desired,  the  quantity  B  is  the  indicator 
on  how  to  proceed.  Thus,  if  it  is  desired  to  place  more 
emphasis  on  category  one,  two  alternatives  are  available 
to  maintain  optimality.  One  alternative  would  be  to  still 
maintain  the  relationship  X  (  -  b^  £  B*  X  -  . 

The  second  alternative  would  be  to  shift  resources  among 
the  variables  of  which  B  is  a  function.  Thus,  resources 
could  be  taken  from  category  two,  or  a  combination  of 
categories  to  accomplish  this  emphasis  change.  This  in¬ 
formation  would,  of  course,  also  assist  the  research 
manager  in  determining  what  values  to  perturb  in  investi¬ 
gation  of  other  solutions. 

Problem  two  also  satisfies  our  intuition  with  respect 
to  the  ' ,  Here  Eg'  has  the  greatest  value  of  all  the 
categories.  Once  again,  intuition  would  indicate  that  the 
S^atest  emphasis  should  be  placed  on  category  nine.  After 
considering  the  total  budget,  a  change  of  emphasis  to  the 
remainSfe  category's  lower  bounds  would  then  take  place. 
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After  solving,  the  problem  bg  linear  programming  techniques, 
the  solution  was  found  to  agree  with  that  of  the  intuitive 
approach. 

Whether  this  method  can  be  generally  employed  is  a 
auestion  for  further  investigation.  If  the  intuitive 
approach  proves  correct,  linear  programming  techniques  need 
not  be  used  to  maximize  individual  classification  systems. 

As  the  intuitive  approach  was  unsuccessful  in  predicating 
results  for  coupled  classification  systems  as  in  problem 
five,  linear  programming  techniques  may  be  highly  useful 
in  these  situations. 

The  maximization  of  the  B  system  results  in  a  loss  of 
(0,40)  units  of  research  as  measured  in  the  A  system,  A 
comparison  of  these  two  systems  in  graph  two  can  be  mis¬ 
leading.  Graph  two  indicates  that  to  change  the  emphasis 
from  the  A  to  the  B  system,  categories  1,  5,  6,  and  9 
should  be  perturbed.  This  is  not  the  case,  however,  as 
problem  5  indicates.  A  problem  also  arises  in  finding 
the  best  position  between  these  two  extremes  and  determining 
the  extent  to  which  the  categories  should  be  re-emphasized. 
This  information  is  also  revealed  in  problem  five. 

The  summing  of  the  A  and  B  system  would  be  of  interest 
if  such  a  relationship  had  a  particular  meaning  to  a 
research  organization.  It  was  done  here  for  experimental 


56 


ourposes.  As  a  new  function  was  created  bv  this  operation* 
it  is  reasonable  to  suppose  that  the  resulting  set  of 
x's  which  maximize  this  problem  could  not  be  predicted. 

Such  was  the  case. 

Changes  to  the  vKC^J's  were  accomplished  and  the 
results  are  displayed  in  table  12.  These  results  are  in 
accordance  with  theory  in  that  no  significant  change  in 
the  x  values  chosen  occurs.  For  categories  1,  3,  4,  5 
and  7,  the  lower  bounds  were  eventually  placed  at  zero  to 
note  any  effect  upon  the  results.  No  change  in  category 
emphasis  occurred.  Placing  a  lower  bound  of  a  category 
at  zero  can  assist  the  research  manager  in  deciding  whether 
to  support  a  particular  category.  This  situation  may 
arise  when  a  new  category  is  to  be  added  to  an  existing 
program  or  when  a  question  of  continuing  supnort  to  a 
category  is  raised.  If,  for  example,  the  set  of  W(C^) 
in  Problem  4,  Part  4,  had  been  chose/}  categories  3,  4,  5, 
and  7  would  not  have  been  supported  while  category  one 
would  have  received  support. 

In  Problem  5,  the  A  classification  system  was  optimized 
with  respect  to  the  3  classification  system  for  various  B 
values.  This  problem  can  aid  the  research  manager  in 
determining  to  what  degree  to  vary  a  category  and  how  this 
variance  will  change  effectiveness  of  a  particular  system. 
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Thus,  a  soccific  guide  concerning  the  method  of  increasing 
emphasis  on  attributes  of  other  classification  systems  is 
at  hand.  Table  13  would  indicate  the  optimal  manner  by 
which  resources  should  be  allocated  to  accomp] ish  this.  A 
directive  to  increase  emphasis  on  a  particular  attribute 
can  now  be  optimally  accomplished  using  a  specified  category 
reemphasis . 

Graoh  3,  the  maximum  effectiveness  comoarisor.  between 
the  A  and  B  classification  svst&ms ,  is  non-linear. 
Soecifically ,  a  loss  of  one  unit  of  effectiveness  from  307 
to  306  units  in  the  A  system  results  in  a  net  gain  to  the 
h  s'-stem  of  4,7  units.  A  decrease  of  the  A  system  from 
306  to  305  units  results  in  a  lower  gain  of  3.5  units, 

A  research  manager  might  feel  that  a  loss  of  two  units  in  the 
A  system  was  worth  the  increase  of  eight  units  in  the  B 
svstem.  As  this  problem  represents  reality  to  a  'greater 
degree  than  do  the  others,  it  is  the  most  important. 

The  ooint  at  which  the  A  system  equals  306  units  is 
of  interest.  This  point  is  the  intersection  between  the  two 
lines  of  sloDe  3.56  and  4.73.  A  point  of  changing  slope 
on  the  graph  may  result  due  to  the  particular  configuation 
of  the  objective  function  that  is  maximized.  Further  study 
is  needed  to  explain  this  phenomenon. 

Problem  6  reveals  the  results  of  a  cut  in  the  budget. 

The  results  indicate  that  all  categories  ar?  placed  at  their 
lower  limit  with  the  excention  of  category  nine.  This  method 
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of  adjustment  will  not  always  be  the  case  but  will  deoend 
on  the  amount  that  the  budget  is  cut.  Category  9  received 
the  remainder  of  the  funds  available  after  all  other 
categories  had  been  supported  to  their  lower  limit.  As 
Category  9  has  the  highest  ,  this  reapportining  method 
is  in  agreement  with  intuition. 

To  evaluate  the  effect  upon  the  system  bv  the  addition 
of  a  new  category,  the  problem  can  be  altered  to  fit  these 
new  conditions  and  the  program  re-run. 

In  the  hands  of  a  skilled  research  manager,  the 
Linear  programming  technique  can  be  a  valuable  aid.  By 
recognizing  the  limitations  of  the  model  and  by  applving 
his  experience,  the  research  manager  can  gain  information 
on  the  workings  of  his  program.  If  a  "yardstick"  is 
available  to  measure  research  output  in  order  to  bring 
greater  accuracy  to  the  p-s,  then  this  technique  will  be 
of  great  interest. 
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GLOSSARY 


1 


Attribute  -  A  reason  for  support  of  a  category  and  a 
working  level  translation  of  a  portion  of  the  mission  (ob¬ 
jective)  of  OMR,  Hopefully,  it  is  quantifiable. 

Balanced  Program  -  That  program  which  includes  an 
appropriate  amount  of  effort  in  every  field  of  service  in 
which  we  may  reasonably  be  expected  to  engage  is  a  balanced 
program.  The  operative  factors  are  therefore  the  list  of 
services  required  by  the  ONR  Mission  (i,e,,  Objectives)  and 
the  proportions  of  the  total  effort  to  be  devoted  to  each. 
Boundary  Conditions  -  The  constraints  on  allocation  of 
resources  to  categories. 

Category  -  A  research  effort  composed  of  a  set  of 

tasks  which  have  a  common  center  of  interest,,  The  division 

is  one  which  should  provide  a  unit  conveniei t  for  planning 

purposes,  rather  than  being  related  to  description  of  the 

total  program  as  in  the  case  of  "projects"  and  "sub-projects," 

Mission  -  The  job  imposed  by  orders,  instructions, 

directives,  and  the  like.  In  using  the  term,  it  should  be 

made  clear  what  group  is  being  referred  to,  as  "Navy  Mission," 

etc.  The  ONR  Mission  is  defined  in  complete  detail  by  ONR 

Instruction  6430. IB  of  16  August  1961, 

*Ad  Hoc  Research  Planning  Committee  at  the  Office  of 
Naval  Research 
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Objectives  -  A  more  detailed  description  of  the  ONR 
Mission.  An  objective  is  thus  one  of  the  services,  the 
sum  of  which  constitute  the  OMR  Mission. 

Program  -  Used  without  an  adjective,  the  sum  total  of 
the  efforts  directed  toward  accomplishment  of  the  ONR 
Mission.  The  Research  Program  is  that  portion  of  the  effort 
which  is  under  the  cognizance  of  the  Assistant  Chief  for 
Research, 

Project  -  The  long-  -ange  effort  of  a  developing  agency 
which  extends  over  the  full  time  span  of  the  development  of 
a  system,  or  that  which  constitutes  classes  of  work  that 
continue  indefinitely.  Each  project  appears  as  a  line 
item  in  the  Annual  Navy  RDTSE  Program.  (Definition  required 
by  DOD  Directive  5200.10,  1  August  1962).  See  also  "category" , 
"subproject" . 

Requirement  -  A  plan  or  statement  indicating  the  need 
or  demand  for  personnel,  equipment,  supplies,  resources, 
facilities  or  services  by  specific  quantities,  for  specific 
periods  of  time  or  at  a  specific  time  (JCS  Pub.  1). 

Research  Planning  -  The  process  of  defining  courses 
of  action  to  be  employed  in  achieving  an  effective  and 
balanced  research  program  and  the  communication  of  this  process 
to  other  interested  organizations.  The  selection  of  courses 
of  action  through  a  systematic  consideration  of  alternatives. 
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Technological  Barrier  -  An  area  of  ignorance  that 


prevents  the  development  of  a  desired  end  item  or  capabilitVv 


APPENDIX  II 

DETAILED  PROBLEM  ONE  FORMULATION 

Appendix  two  consists  of  the  intermediate  steps  in¬ 
volved  in  solving  Droblem  one.  They  are  provided  to  assist 
the  reader  in  reproducing  these  same  results.  The  notation 
used  may  be  found  in  Garvin  [1], 

FORMULATION  FOR  COMPUTATION  BY  SIMPLEX  METHOD  OF  PROBLEM  I 
Maximize  Cl  (,399x*  +  ,240x  +  .262  x  +  .471  x  +.521  x 

+.311  x  +  .145  x  +  .234  x  +  . 372x  +  .372  x  )  ] 


SUBJLCT  TO 


1. 

X1 

- 

X11 

=  53.7 

2, 

X1 

♦ 

x12 

=  80.6 

3. 

x2 

- 

x13 

=116.3 

4  . 

x2 

+ 

x14 

=139.9 

5. 

X3 

- 

x15 

=  21.5 

6  . 

x3 

+ 

x16 

=  48.4 

7  . 

X4 

- 

x17 

=  8.9 

8  . 

X4 

+ 

X1 8 

=  10.8 

9, 

x5 

- 

x19 

=  57.5 

10. 

XS 

♦ 

x20 

=  75.5 

11. 

x6 

- 

X21 

=118.2 

12. 

x6 

+ 

x22 

=322.3 

13. 

x7 

x2  3 

=  10.8 

14. 

x7 

+ 

x24 

II 

O 

CO 

15. 

X8 

- 

x25 

=  89.5 

16. 

x8 

♦ 

x2  5 

=  96.7 

17. 

x  9 

- 

x2  7 

=  214.9 

18. 

X9 

+ 

x2  8 

=  304.4 

19. 

x10 

- 

x2  9 

=  89.5 

20. 

X10 

♦ 

x30 

=  114.6 

21  . 

.2*1 

i*i 

+ 

X31 

=  895.3 

where 

X11 

thru 

are  slack  variables 
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appendix  III 


Examples  of  Attributes,  Branches,  Categories  and  Classifi¬ 
cation  Svstem  renrinted  from  the  Ad  Hoc  Research  Planning 
Committee  Renort„ 

List  of  Some  Existing  Attributes  -  Not  Independent 

1.  Scientific  value 

2.  Military  value 

3.  Technological  value 

4.  Windows 

5.  Eissemination 

6«  Coordination  of  Research 

7.  Prestige 

8.  Contract  with  Scientific  Community 

9.  Pressures  and  interests 

10.  Existance  of  adequate  programs  within  other  Government 
agencies 

11.  Industrial  incentive 

Partial  List  of  ONR  Branches 

1,  Acoustics  Branch 

2,  Georgraphy  Branch 

3,  Geophysics  Branch 

4,  Field  Projects  Branch 

5,  Mec-allurey  Branch 

6,  Chemistry  Branch 
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7.  Prooul r ion  Chemistry  Branch 

8.  Power  Branch 

9.  Physics  Branch 

10.  Nuclear  Physics  Branch 

11.  Electronics  Branch 

12.  Mathematics  Branch 

13.  Logistics  and  Mathematical  Statistics  Branch 

14.  Information  Systems  Branch 

15.  fluid  Dynamics  Branch 

16.  Structural  Mechanics  Branch 

17.  Physiology  Branch 

18.  Biochemistry  Branch 

19.  Microbiology  Branch 

20.  Medicine  and  Denistry  Branch 

21.  Biology  Branch 

22.  Group  Psychology  Branch 

23.  Physiological  Psychology  Branch 

24.  Engineering  Psychology  Branch 

25.  Personnel  and  Training  Branch 

Breakdown  of  Electronics  Branch  into  Categories 
ELECTRONICS  BRANCH 
Areas  of  New  Emphasis 

a.  Submarine  Detection 

b.  Communications 
Communications  Theory 


Current  Program  Categories 

a.  Circuit  Analysis  and  Synthesis 

b.  Information  Theory  and  Coding 

c.  Date  Processing 

d.  Bio -electronics 
Physical  Electronics 


Cur re nt  Program  Categories 


a.  Solid  State  Electronics 

b.  Cathode  Characteristics  tine 

c.  Electron  Ballistics 

d.  Plasma  Studies 

Electromagnetic  'Wave  Propcgation 


rmionics *  Field  Emission) 


and  Radiation 


Current  Program  Categories 

a.  Anomalous  Propagation-Modes 

b.  VLF  and  ELF  - 

c.  Antennas 

d.  Geomagnetics 

e.  Direction  Finding 
Electronic  Components 


Current  Program  Categories 

Solid  State  Devices 

b.  Microelectronics 

c.  Electron  Tubes 

d.  Application  of  New  Materials 
Radio  Astrophysics 


Current  Program  Categories 

a .  Solar  Flare  Studies 

b.  Radio  Source  Positioning 

c.  Cosmology  via  Radio  Astronomy 

d.  Planetary  Astronomy 
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Examples  of  Classification  Systems  How  In  Use 


I,  Chronological 

A.  Short  Range 
Bs  Intermediate  Range 
Ca  Long  Range 
D,  Other  or  combination 

II.  ENVIRONMENTAL  (Spatial) 

A.  Aero  Space 

B.  Surface  (Water,  Land,  Amphibious) 

C.  Underseas  (ASW,  Mining  Submarine) 

D.  Other  or  combination 

III.  CONVENTIONAL  SHIPBOARD 

A.  Engineering 

B.  Operations 

C.  Deck 

D.  Ordnance 

E.  Aviation 

F.  Medical/Dental 

G.  Supply 

H.  Other  or  combinations 

IV.  OFFENSIVE/DEFENSIVE 

A,  Offensive 

B,  Defensive 

C,  Other  or  Combination 

V.  FUNCTIONAL  OPERATIONAL 
• 

A.  Surveillance 
8,  Command  control 

C.  Intelligence 

D.  Nullification 

Et  Delivery  Platform 
F.  Logistics 
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VI.  CATEGORIES 


A=  Earth  Sciences 
Bo  Material  Sciences 

C.  Physical  Sciences 

D.  Mathematical  Sciences 
Eo  Biological  Sciences 

F.  Psychological  Sciences 

G.  ©Derations  Analysis 
Ho  Other  or  combinations 

VII o  FUNCTIONAL  3Y  BROAD  MISSION 

Ao  Applied  Research 
Bo  Basic  Research 
Co  Development  Test  £  Evaluation 
Do  Management  6  Support 

VIII.  BUDGET  ACTIVITY  (End  Item  Categories) 

A.  Military  Sciences 

B.  Aircraft  and  Related  Equipment 

C.  Missiles  and  Related  Equipment 

D.  Ast.onautics 

Eo  Ships  and  Small  Craft 
Fo  Ordnance  Combat  Vehicles 
G.  Other  Equipment 

Ho  Program  Wide  Management  Support 
lo  Military  Family  Housing 
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